Image processing system and image processing apparatus

ABSTRACT

An image processing system is disclosed that is configured to input color image data, generate color image data identification information identifying the color image data, store the color image data identification information in association with the color image data, generate monochrome image data based on the color image data, combine the color image data identification information with the monochrome image data according to a predetermined format and print the combined monochrome image data on a first recording medium. Also, the image processing system is configured to read the combined monochrome image data from the first recording medium, extract the color image data identification information from the combined monochrome image data, read the color image data stored in association with the extracted color image data identification information, and output the read color image data in a predetermined visible format.

PRIORITY STATEMENT

This application is a divisional under 35 U.S.C. § 121 claiming thebenefit of U.S. application Ser. No. 11/347,410, filed on Feb. 6, 2006,which claims priority under 35 U.S.C. § 119 to Japaneses PatentApplication No. 2005-031057, filed on Feb. 7, 2005 with the JapanesePatent Office, the entire contents of each of which are incorporatedherein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image processing system and an imageprocessing apparatus for performing output control relating to printingof input color image data.

2. Description of the Related Art

In a color image processing apparatus such as a color facsimile machinethat includes a color image transmission apparatus for establishingcolor image data communication between a remotely located communicationcounterpart apparatus, arrangements may be made to automatically printout color image data received from the communication counterpartapparatus on a recording medium such as recording paper. However, areceiver (user) may not wish to have certain types of received imagedata printed out in such a manner. For example, unsolicited images suchas advertisement images and spam images may not be desired by the user.

It is noted that a user may not wish to have certain types of receivedcolor image data or read (scanned) image data printed in the form ofcolor images and may instead wish to have the received color image dataprinted in monochrome format, for example. Generally, in a color imageprocessing apparatus, when color image data are received or read(scanned), such data are unconditionally printed as a color image. Insuch a case, even received/read color image data that do not necessarilyhave to be color printed are printed as color images to thereby wasteconsumable supplies such as color ink or color toner.

Also, when received/read color image data are arranged to be displayedat a monitor, for example, working efficiency may be improved by havingthe received/read color image data printed out on paper for reference.In such a case, since the color information of the received/read imagedata may be viewed at the monitor, the printed image corresponding tothe received/read image data may not have to be in color image format(i.e., the monochrome image format may suffice).

In view of such circumstances, Japanese Laid-Open Patent Publication No.2003-319111 discloses a technique for converting color image datareceived through data communication into monochrome image data andprinting out the converted monochrome image data. However, according tothe above disclosed technique, when a user wishes to have the receivedcolor image data printed as a color image, the user has to go throughthe trouble of inputting a corresponding registration number of theimage data. Thus, the print designating operations may be burdensome andannoying in this case.

Also, in a case where a color image of a page of a book or a catalog,for example, is read (scanned) and the read color image data as imagedata to be subsequently printed are stored in a storage device arrangedwithin the relevant color image processing apparatus or an externalserver apparatus connected to the relevant color image processingapparatus via a network, in general, a corresponding registration numberof the read image data has to be input in order to print out the storedimage data. Thus, the print designating operations may be burdensome andannoying in this case as well.

SUMMARY OF THE INVENTION

According to preferred embodiments of the present invention, an imageprocessing system and an image processing apparatus with good economicalefficiency as well as good operability are provided in which input colorimage data are converted into monochrome image data to be printed, andthe original input color image data are printed in response to a userrequest that may be made through simple operations.

An image processing system according to one preferred embodiment of thepresent invention includes:

a color image input unit configured to input color image data;

an identification information generating unit configured to generatecolor image data identification information identifying the color imagedata input by the color image input unit;

an image data storing unit configured to store the color image dataidentification information in association with the processing colorimage data;

a monochrome image generating unit configured to generate monochromeimage data based on the color image data;

a monochrome image output unit configured to combine the color imagedata identification information with the monochrome image data accordingto a predetermined format and print the combined monochrome image dataon a first recording medium;

an image reading unit configured to read the combined monochrome imagedata from the first recording medium and input the combined monochromeimage data;

an identification information extracting unit configured to extract thecolor image data identification information from the combined monochromeimage data; and

a color image output unit configured to read from the image data storingunit the color image data associated with the color image dataidentification information extracted by the identification informationextracting unit and output the color image data in a predeterminedvisible format.

According to a preferred embodiment of the present invention, the colorimage input unit receives the color image data from a communicationcounterpart.

According to another preferred embodiment of the present invention, thecolor image input unit reads the color image data from a physicaldocument.

According to another preferred embodiment of the present invention, thecolor image output unit prints the color image data on a secondrecording medium.

According to another preferred embodiment of the present invention, thecolor image output unit displays the color image data on a display unit.

According to another preferred embodiment of the present invention, themonochrome image output unit generates barcode image data including thecolor image data identification information, combines the generatedbarcode image data with the monochrome image data, and prints thecombined monochrome image data on the first recording medium; and theidentification information extracting unit extracts the color image dataidentification information from the barcode image data included in thecombined monochrome image data input by the image reading unit.

According to another embodiment of the present invention, the monochromeimage output unit generates two-dimensional code image data includingthe color image data identification information, combines the generatedtwo-dimensional code image data with the monochrome image data, andprints the combined monochrome image data on the first recording medium;and the identification information extracting unit extracts the colorimage data identification information from the two-dimensional codeimage data included in the combined monochrome image data input by theimage reading unit.

According to another embodiment of the present invention, the monochromeimage output unit generates digital watermark data as the color imagedata identification information, combines the generated digitalwatermark data with the monochrome image data, and prints the combinedmonochrome image data on the first recording medium; and theidentification information extracting unit extracts the color image dataidentification information from the digital watermark data included inthe combined monochrome image data input by the image reading unit.

An image processing apparatus according to a preferred embodiment of thepresent invention includes the elements of the image processing systemaccording to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing a configuration of a multifunctionmachine as an embodiment of an image processing apparatus according tothe present invention;

FIG. 2 is a flowchart illustrating process steps of an image data inputcorresponding process performed at the multifunction machine of FIG. 1according to one embodiment of the present invention;

FIG. 3 is a flowchart illustrating process steps of a color image dataoutput process performed at the multifunction machine of FIG. 1according to one embodiment of the present invention;

FIG. 4 is a flowchart illustrating an exemplary specific process step ofa color image data identification information generating process;

FIGS. 5A-5C are flowcharts illustrating exemplary specific process stepsof a color image data identification information adding print process;

FIGS. 6A-6C are flowcharts illustrating exemplary specific process stepsof a color image data identification information extracting process;

FIGS. 7A and 7B are flowcharts illustrating exemplary specific processsteps of a color image data visible output process;

FIG. 8 is a diagram illustrating an exemplary printout of monochromeimage data with a barcode added thereto;

FIG. 9 is a diagram illustrating an exemplary printout of monochromeimage data with a two-dimensional code added thereto;

FIG. 10 is a flowchart illustrating process steps of an image data inputcorresponding process performed in the multifunction machine of FIG. 1according to another embodiment of the present invention;

FIG. 11 is a flowchart illustrating process steps of a color image dataoutput process performed in the multifunction machine of FIG. 1according to another embodiment of the present invention;

FIG. 12 is a block diagram showing a configuration of an imageprocessing system according to an embodiment of the present invention;

FIG. 13 is a flowchart illustrating process steps of an image data inputcorresponding process performed in the image processing system of FIG.12 according to an embodiment of the present invention;

FIG. 14 is a flowchart illustrating process steps of a color image dataoutput process performed in the image processing system of FIG. 12according to an embodiment of the present invention; and

FIG. 15 is a block diagram showing a configuration of an imageprocessing system according to another embodiment of the presentinvention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

In the following, preferred embodiments of the present invention aredescribed with reference to the accompanying drawings.

FIG. 1 is a block diagram showing a configuration of a multifunctionmachine 1 as an embodiment of an image processing apparatus according tothe present invention.

As is shown in this drawing, the multifunction machine 1 according tothe present embodiment includes a CPU 10, a main memory 11, a ROM (ReadOnly Memory) 12, a clock 13, a bus controller 14, a PCI (PeripheralComponent Interconnect) bridge 15, a cache memory 16, a scannercontroller 17, a scanner 18, a print controller 19, a print engine 20, ahard disk 21, a HD (hard disk) controller 22, a LCD controller 23, a LCD24, a LAN controller 25, a LAN I/F (interface) 26, a G3 Fax controller27, a PSTN (Public Switched Telephone Network) I/F 28, a key inputcontroller 29, a hard key 30, a touch panel controller 31, a touch panel32, a RTC (Real Time Clock) 33, a CPU bus 34, a PCI bus 35, and an X bus(internal bus) 36, for example.

The CPU 10 is configured to execute and process control processingprograms and OS (operating system) stored in the ROM 12.

The main memory 11 may be a DRAM (Dynamic Random Access Memory) that isused as a working area of the CPU 10, for example.

The ROM 12 has various programs preformatted therein for realizingsystem startup when the power is turned on and performing variousfunctions of the multifunction machine 1.

The clock 13 includes a crystal oscillator and a dividing circuit, andis configured to generate a clock for controlling the operation timingsof the CPU 10 and the bus controller 14.

The bus controller 14 is configured to control data transmissionrealized by the CPU bus 34 and the X bus 36.

The PCI bridge 15 is configured to realize data transmission between thePCI bus 35 and the CPU 10 using the cache memory 16.

The cache memory 16 may be realized by a DRAM that is used by the PCIbridge 35.

The scanner controller 17 is configured to control document readingoperations of the scanner 18.

The scanner 18 is configured to scan (read) an image of a page using aCCD line sensor.

The print controller 19 is configured to control operations of the printengine 20.

The print engine 20 is configured to use toner to create a color imageor a monochrome image on a recording medium such as paper.

The hard disk 21 is configured to store data including image data inputfrom the scanner 18, image data received through communication, andbarcode data as identification information of color image data, forexample.

The HD controller 22 includes an interface with the hard disk 21 such asan IDE (Integrated Device Electronics) interface, and is configured torealize high speed data transmission between the hard disk 21.

The LCD controller 23 is configured to perform control operations forrealizing D/A (digital/analog) conversion of data such as text data andgraphic data, and displaying the data at the LCD 24.

The LAN controller 25 may realize a communication protocol conforming tothe IEEE (Institute of Electrical and Electronics Engineers) 802.3standard, for example, and is configured to control communication withanother apparatus connected to an Ethernet LAN via its LAN I/F 26.

The G3 Fax controller 27 is configured to use a built-in modem totransmit/receive a G3 Fax modem signal to realize G3 Fax communicationaccording to the ITU-T Recommendation T.30. The G3 Fax controller 27enables transmission/reception of color image data in G3 Fax modeaccording to the ITU Recommendation T.30 Annex E (TTC standard JT-T30Annex D).

The key input controller 29 is configured to convert serial data inputfrom the hard key 30 into parallel data.

The touch panel controller 31 is configured to detect a portion of thetouch panel 32 that is in contact with a touching object such as afinger, and acquire position information of the detected portion. Thetouch panel 32 is layered and adhered to the LCD 24.

The RTC33 is a date/time clock that is backed up by a battery (notshown).

In the following, operation processes performed in the multifunctionmachine 1 according to embodiments of the present invention aredescribed. It is assumed that the process steps of these operationprocesses are executed by the CPU 10 according to control processingprograms stored in the ROM 12 using the main memory 11 as a working areaunless specified otherwise.

FIG. 2 is a flowchart illustrating a process flow of an image data inputcorresponding process that is performed in the multifunction machine 1according to one embodiment.

As is shown in this drawing, in this process, input of monochrome orcolor image data is monitored. Specifically, image input monitoring isrealized by determining whether image data are received or a document isset to the scanner 18 (i.e., loop realized by determination step S101, anegative determination ‘NO’ in step S101, determination step S102, andthe negative determination ‘NO’ in step S102).

In the determination step S101, reception of image data is monitored. Inthis example, image data reception may be any type of receptionincluding reception realized by the G3 Fax controller 27 through G3facsimile communication via a PSTN (Public Switched Telephone Network)200 (see FIG. 1), reception through real time network facsimilecommunication based on the ITU-T Recommendation T.38 via a LAN 300 (seeFIG. 1), reception through email network facsimile transmission based onthe ITU-T Recommendation T.37, and image data reception in response to aprint request from another PC (personal computer) connected via the LAN300 according to the SOAP protocol, for example. In other words, thereception being monitored in the determination step S101 may generallyinclude any form of image data input from an apparatus or system otherthan the image processing apparatus 1. It is noted that color image datatransmission/reception through G3 facsimile communication is defined inthe ITU-T Recommendation T.30 Annex E.

When the G3 Fax controller 27 of the multifunction machine 1 receivescolor image data through G3 facsimile communication according to theITU-T Recommendation T.30 Annex E, the CPU 10 issues a document numberfor unambiguously identifying the received color image data, and storesthe document number in association with the corresponding received colorimage data in the hard disk 21.

In the present example, image data may be input in another manner;namely, a document may be scanned (read) by the scanner 18 and thescanned image data may be input to the multifunction machine 1. Suchinput of image data through scanning by the scanner 18 is monitored inthe determination step S102.

When it is determined in step S101 that image data are received (‘Yes’in step S101), the image data are received and stored in the hard disk21 (step S103), and the process moves on to determination step S105.

When it is determined in step S102 that a document has been set (‘Yes’in step S102), the image of the document is scanned and the scannedimage data are stored in the hard disk 21 (step S104) after which theprocess moves on to the determination step S105.

In the determination step S105, a determination is made as to whetherthe input image data correspond to color image data or monochrome imagedata. If it is determined that the input image data correspond tomonochrome image data (‘No’ in step S105), a normal monochrome imagedata corresponding process is performed (step S106).

If it is determined in step S105 that the input image data correspond tocolor image data (‘Yes’ in step S105), color image data correspondingprocesses are performed as is described below.

Specifically, the process moves on to step S107 in which a color imagedata identification information generating process is performed. Then,in step S108, the generated color image data identification informationis associated with the relevant input color image data, and the colorimage data identification information is stored in the hard disk 21 inassociation with the relevant input color image data. It is noted thatthe relevant input color image data for which the color imageidentification information is generated are already stored in the harddisk 21 (step S103), and may be referred to as ‘processing color imagedata’ in the following descriptions.

Then, in step S109, processing monochrome image data are generated fromthe processing color image data. In one example, color image datareceived through G3 facsimile communication are encoded according to theJPEG standard (ITU-T Recommendation T.81, ISO/IEC 10918-1), and thereceived color image data are decoded according to the JPEG standardafter which brightness component data of the respective pixels of thedecoded image data are extracted to generate the monochrome image data.

Then, the color image data identification information generated in stepS107 is added to (combined with) the generated monochrome image dataaccording to a predetermined format (details of which are describedbelow), and the generated monochrome image data are printed on arecording medium such as recording paper (step S110) after which theprocess is ended.

According to the present embodiment, input color image data are printedas a monochrome image so that color toner, color ink, or a color inkribbon (according to the print method implemented by the print engine20) may be saved, and operations cost may be reduced.

More specifically, in the present embodiment, input color image data isautomatically printed as a monochrome image without any commandoperation input from the user. It is noted that in most cases, contentsor features of the input color image data may be adequately grasped fromits corresponding printed monochrome image. Thus, the present embodimentmay be preferred taking into consideration the merits of printing inputimage data as a monochrome image as opposed to a color image.Specifically, cost increase due to color printing undesired images suchas color advertisement and spam images may be avoided. Also, in thepresent embodiment, a color image is not output (printed) fromreproducing (copying) a color document; that is, a monochrome image isoutput upon reproducing the color document while the color image dataobtained in the copying operation are stored to be used in a subsequentreproducing operation. In this way, a document may normally bereproduced as a monochrome image so that cost increase may be avoided.

It is noted that in some cases, a user may desire to view a printedimage of input color image data in its original color image format. Theimage processing apparatus according to an embodiment of the presentinvention is configured to adequately correspond to such desires of theuser.

Accordingly, the image processing apparatus 1 of the present embodimentis configured to perform the image data input corresponding process asis illustrated in FIG. 2, and is also configured to perform a colorimage data output process as is illustrated in FIG. 3, for example.

In the color image data output process of FIG. 3 according to oneembodiment, setting of a document to the scanner 18 is monitored (looprealized by determination step S201 and the negative determination step‘NO’ in step S201). When a document is set to the scanner 18 (‘Yes’ instep S201), the document is scanned and monochrome image data of thedocument are obtained (step S202). It is noted that in step S202, colorscanning of the document may be performed to obtain color image data ofthe document and post processing may be performed on the color imagedata to obtain monochrome image data corresponding to the obtained colorimage data, or alternatively, monochrome image data may be directlyobtained from the document through monochrome scanning, for example.

Then, a color image data identification information extracting processis performed on the obtained monochrome image data (step S203), andcolor image data corresponding to the extracted color image dataidentification information are read from the hard disk 21, and the readcolor image data are output in visible format (step S205).

By performing the above-described processes according to the presentembodiment, color image data that are printed as a monochrome image maybe output as a color image as is necessary or desired based on theprinted monochrome image. More specifically, in the present embodiment,instead of having to go through the trouble of memorizing acorresponding registration number for desired color image data andrequesting for the output of the color image data by designating theregistration number, the user may simply set the printed monochromeimage that he/she desires to view in color image format to the scanner18 in a manner similar to the procedure for operating the scanner 18 toscan a document to be copied or transmitted, for example. In this way, acolor image processing apparatus with good economical efficiency andgood operability may be realized.

FIG. 4 is a flowchart illustrating a specific process step that may beperformed in the color image data identification information generatingprocess of step S107 of the image data input corresponding processillustrated in FIG. 2 according to one embodiment.

In FIG. 4, a document number is generated as the color image dataidentification information (step S250). For example, the document numbermay be a four-digit number string such as ‘0099’, a symbol string suchas ‘ABCDE’, or a combination of numbers and symbols. In other words, thedocument number may be any form of non-overlapping information used toidentify a corresponding set of color image data from one or more othersets of color image data that are stored in the hard disk 21.

In a case where the process step of FIG. 4 is performed as the colorimage data identification information generating process step S107 ofFIG. 2, the process step S110 of FIG. 2 for adding (combining) the colorimage data identification information and printing the combinedmonochrome image data may be performed according to one of the processflows illustrated in FIG. 5A, 5B, or 5C, for example.

Further, when the process flow illustrated in FIG. 5A, 5B, or 5C isperformed as the process step S110 of FIG. 2, the process flowillustrated in FIG. 6A, 6B, or 6C may be performed, respectively, as thecolor image data identification information extracting process step S203of FIG. 3.

In the process flow of FIG. 5A (step S110), barcode image data includingdata representing the document number are generated (step S301), and thegenerated barcode image data are composited with the processingmonochrome image data currently being developed at the main memory 11(step S302) after which the composite image data are printed (output) onrecording paper by the print engine 20 (step S303).

It is noted that the barcode image data generating step S301 may beperformed according to the NW7 (JIS-X-0503) specification, for example.Also, as is shown in FIG. 8, the barcode image data compositing stepS302 may be executed in a manner such that a barcode image Bcode1corresponding to the generated barcode image data may be recorded at theupper left hand portion of the recording paper starting from a positionsituated 10 mm to the right and 10 mm downward from the upper left handcorner position of the recording paper, for example. It is noted thatthe position at which the barcode image is inserted (added) is notlimited to the position as is illustrated in FIG. 8, and in otherexamples, the barcode image may be inserted at the upper right handcorner portion, the lower right hand corner portion, the lower left handcorner, or any other position within the recording paper provided thatthe barcode image does not overlap with the monochrome image to beprinted.

When the process flow of FIG. 5A is performed as the process step S110of FIG. 2, the process flow as is illustrated in FIG. 6A is performed asthe process step S203 of FIG. 3.

In the process flow of FIG. 6A (step S203), first, the barcode imagedata within the monochrome image data are identified (step S401). Sinceit may be determined in advance that the recording start position forthe barcode image is at the point 10 mm to the right and 10 mm downwardwith respect to the upper left hand corner of the recording paper, therecording position of the barcode image data may be easily determined.In one specific example, when the scanning density of the scanner 18 is200 dpi (dots per inch), a barcode data recognition process is startedfrom the 75^(th) pixel to the right and 75 pixels downward from thepixel at upper left hand corner of the scanned image data.

It is noted that the barcode data recognition start position isdetermined in advance taking into consideration factors such as errorsin the recording position of the recording paper, and errors in thescanning position of the scanner 18, for example. It is noted that inone example, the barcode image may be recognized according to a barcoderecognition method as is described in Japanese Laid-Open PatentPublication No. 11-164114, which is hereby incorporated by reference inits entirety. Then, the code pattern of the recognized barcode isdecoded and the color image data identification information representedby the barcode; namely, the document number, is extracted (step S402).In turn, the color image data stored in the hard disk 21 that isassociated with the extracted document number may be determined.

In the process flow of FIG. 5B (step S110), two-dimensional code imagedata including data representing the document number are generated (stepS311), and the generated two-dimensional code image data are compositedwith the processing monochrome image data currently being developed atthe main memory 11 (step S312) after which the composite image data areprinted (output) on recording paper by the print engine 20 (step S313).

It is noted that the two-dimensional code image data generating stepS311 may be performed according to the QR code (JIS-X-0510)specification, for example. Also, as is shown in FIG. 9, thetwo-dimensional code image data compositing step S312 may be executed ina manner such that a two-dimensional code image Bcode2 corresponding tothe generated two-dimensional code image data may be recorded at theupper left hand portion of the printed recording medium starting from aposition situated 10 mm to the right and 10 mm downward from the upperleft hand corner position of the recording paper, for example. It isnoted that the position at which the two-dimensional code image isinserted (added) is not limited to the position as is illustrated inFIG. 9, and in other examples, the two-dimensional code image may beinserted at the upper right hand corner portion, the lower right handcorner portion, the lower left hand corner portion, or any otherposition within the recording paper provided that the two-dimensionalcode image does not overlap with the monochrome image to be printed.

When the process flow of FIG. 5B is performed as the process step S110of FIG. 2, the process flow as is illustrated in FIG. 6B is performed asthe process step S203 of FIG. 3.

In the process flow of FIG. 6B (step S203), first, the two-dimensionalcode image data within the monochrome image data are identified (stepS411). Since it may be determined in advance that the recording startposition of the two-dimensional code image data is at the point 10 mm tothe right and 10 mm downward with respect to the upper left hand cornerof the recording paper, the recording position of the two-dimensionalcode image data may be easily determined. In one specific example, whenthe scanning density of the scanner 18 is 200 dpi (dots per inch), atwo-dimensional code data recognition process is started from the75^(th) pixel to the right and 75 pixels downward from the pixel at theupper left hand corner of the scanned image data.

It is noted that the two-dimensional code data recognition startposition is determined in advance taking into consideration factors suchas errors in the recording position of the recording paper, and errorsin the scanning position of the scanner 18, for example. It is notedthat the two-dimensional code image may be recognized according to atwo-dimensional code image recognizing method as is described inJapanese Laid-Open Patent Publication No. 2001-256425, for example.Then, the code pattern of the recognized two-dimensional code is decodedand the color image data identification information represented by thetwo-dimensional code; namely, the document number, is extracted (stepS412). In turn, the color image data stored in the hard disk 21 that isassociated with the extracted document number may be determined.

In the process flow of FIG. 5C (step S110), digital watermark datarepresenting the document number are composited with the processingmonochrome image data currently being developed at the main memory 11(step S321) after which the composite image data are printed (output) onrecording paper by the print engine 20 (step S322).

It is noted that the digital watermark data compositing step S321 may beperformed according to a technique disclosed in Japanese Laid-OpenPublication No. 2003-338924, for example. Specifically, a text area maybe extracted from the monochrome image data, and digital watermark datamay be embedded in the extracted text area.

When the process flow of FIG. 5C is performed as the process step S110of FIG. 2, the process flow as is illustrated in FIG. 6C is performed asthe process step S203 of FIG. 3.

In the process flow of FIG. 6C (step S203), first, the digital watermarkdata within the monochrome image data are extracted (step S421), and thecolor image data identification information represented by the digitalwatermark data; namely, the document number, is extracted (step S422).In turn, the color image data stored in the hard disk 21 that isassociated with the extracted document number may be determined.

As can be appreciated from the above descriptions, various methods maybe employed for adding (combining), identifying, and/or extracting colorimage data identification information with respect to monochrome imagedata to be printed. It is noted that such methods are by no meanslimited to the examples described above. In one alternative example, thedocument number may be represented by text, and the text may be added to(combined with) the monochrome image data and printed at a predeterminedposition on a recording paper along with the monochrome image data. Insuch a case, the document number may be extracted through characterrecognition, for example. Also, the document number may be recorded onand read from an IC tag that is embedded in the recording paper. Such anarrangement may be advantageous if the price of such IC tag embeddedrecording paper is reduced. In another example, the document number maybe magnetically recorded on and read from the recording paper.

In the following, exemplary process flows of the color image datavisible output process step S205 in the color image data output processof FIG. 3 are described.

FIGS. 7A and 7B are flowcharts illustrating exemplary specific processsteps for realizing the color image data visible output process stepS205 of FIG. 3.

In the example of FIG. 7A, the color image data are displayed at adisplay such as the LCD 24 of FIG. 1, for example (step S501).

In this way, the user may view the original color image datacorresponding to printed monochrome image data through simpleoperations.

In the example of FIG. 7B, the color image data are printed on arecording medium such as recording paper, for example (step S511). Morespecifically, the color image data may be color printed by the printengine 20 of FIG. 1, for example.

In this way, the user may view the original color image datacorresponding to printed monochrome image data through simpleoperations.

In another example, the color image data may be displayed through theprocess step of FIG. 7A, and then printed thereafter if a color printingcommand is issued. In this way, execution of unnecessary color printingoperations may be prevented. In this example, the user may endoperations if he/she is satisfied by viewing the color display of thecolor image data; on the other hand, the user may execute color printcommand operations if he/she wishes to print the color image data inorder to further scrutinize the image or to keep the image, for example.

According to an embodiment, by combining the image data inputcorresponding process of FIG. 2 and the color image data output processof FIG. 3, input color image data are basically automatically printed inmonochrome format in order to reduce printing cost, and the originalcolor image data is output in visible format though color display orcolor printing with simple operations when a request for such an outputis issued by the user. In this embodiment, processes for adding colorimage data identification information to the corresponding monochromeimage data to be printed and extracting the color image dataidentification information have to be performed. It is noted that in analternative embodiment, such adding and extracting processes may beomitted.

For example, an image data input corresponding process as is illustratedin FIG. 10 may be performed instead of the image data inputcorresponding process of FIG. 2, and a color image data output processas is illustrated in FIG. 11 may be performed instead of the color imagedata output process of FIG. 3.

In the image data input corresponding process of FIG. 10, first,monitoring for monochrome or color image data input is performed.Specifically, the image data input monitoring is realized by determiningwhether image data are received or a document is set to the scanner 18(i.e., loop realized by determination step S601, a negativedetermination ‘NO’ in step S601, determination step S602, and thenegative determination ‘NO’ in step S602).

In the determination step S601, reception of image data is monitored. Inthis example, image data reception may be any type of receptionincluding reception realized by the G3 Fax controller 27 through G3facsimile communication via a PSTN (Public Switched Telephone Network)200 (see FIG. 1), reception through real time network facsimilecommunication based on the ITU-T Recommendation T.38 via a LAN 300 (seeFIG. 1), reception through email network facsimile transmission based onthe ITU-T Recommendation T.37, and image data reception in response to aprint request from another PC (personal computer) connected via the LAN300 according to the SOAP protocol, for example. In other words, thereception being monitored in the determination step S601 may generallyinclude any form of image data input from an apparatus or system otherthan the image processing apparatus 1. It is noted that color image datatransmission/reception through G3 facsimile communication is defined inthe ITU-T Recommendation T.30 Annex E.

When the G3 Fax controller 27 of the multifunction machine 1 receivescolor image data through G3 facsimile communication according to theITU-T Recommendation T.30 Annex E, the CPU 10 issues a document numberfor unambiguously identifying the received color image data, and storesthe document number in association with the corresponding received colorimage data in the hard disk 21.

In the present example, image data may be input in another manner;namely, a document may be scanned by the scanner 18 and the scannedimage data may be input to the multifunction machine 1. Such input ofimage data through scanning by the scanner 18 is monitored in thedetermination step S602.

When it is determined in step S601 that image data are received (‘Yes’in step S601), the image data are received and stored in the hard disk21 (step S603), and the process moves on to determination step S605.

When it is determined in step S602 that a document has been set (‘Yes’in step S602), the image of the document is scanned and the scannedimage data are stored in the hard disk 21 (step S604) after which theprocess moves on to the determination step S605.

In the determination step S605, a determination is made as to whetherthe input image data correspond to color image data or monochrome imagedata. If it is determined that the input image data correspond tomonochrome image data (‘No’ in step S605), a normal monochrome imagedata corresponding process is performed (step S606).

If it is determined in step S605 that the input image data correspond tocolor image data (‘Yes’ in step S605), a color image data correspondingprocesses are performed as is described below.

Specifically, the process moves on to step S607 in which processingmonochrome image data are generated from the input processing colorimage data. Then, in step S608, the generated monochrome image data orcharacteristic information representing characteristics of the generatedmonochrome image data may be stored as color image data identificationinformation in the hard disk 21 in association with the relevant inputcolor image data that are already stored in the hard disk 21.

Then, in step S609, the generated monochrome image data are printed onrecording paper by the print engine 20 without adding any additionaldata thereto.

According to the present embodiment, input color image data are printedas a monochrome image so that color toner, color ink, or a color inkribbon (according to the print method implemented by the print engine20) may be saved, and operations cost may be reduced.

More specifically, in the present embodiment, input color image data isautomatically printed as a monochrome image without any commandoperation input from the user. It is noted that in most cases, contentsor features of the input color image data may be adequately grasped fromits corresponding printed monochrome image. Thus, the present embodimentmay be preferred taking into consideration the merits of printing inputimage data as a monochrome image as opposed to a color image.Specifically, cost increase due to color printing undesired images suchas color advertisement and spam images may be avoided. Also, in thepresent embodiment, a color image is not output (printed) fromreproducing (copying) a color document; that is, a monochrome image isoutput upon reproducing the color document while the color image dataobtained in the copying operation are stored to be used in a subsequentreproducing operation. In this way, a document may normally bereproduced as a monochrome image so that cost increase may be avoided.

It is noted that in some cases, a user may desire to view a printedimage of input color image data in its original color image format. Theimage processing apparatus according to an embodiment of the presentinvention is configured to adequately correspond to such desires of theuser.

Accordingly, in one embodiment, the image processing apparatus 1 isconfigured to perform the color image data output process of FIG. 11which corresponds to the image data input corresponding process of FIG.10.

In the color image data output process of FIG. 11, setting of a documentto the scanner 18 is monitored (loop realized by determination step S701and the negative determination step ‘NO’ in step S701). When a documentis set to the scanner 18 (‘Yes’ in step S701), the document is scannedand monochrome image data of the document are obtained (step S702). Itis noted that in step S702, color scanning of the document may beperformed to obtain color image data of the document and post processingmay be performed on the color image data to obtain monochrome image datacorresponding to the obtained color image data, or alternatively,monochrome image data may be directly obtained from the document throughmonochrome scanning, for example.

Then, in step S703, the monochrome image data obtained in-step S702 orcharacteristic information thereof as color image data identificationinformation is compared with color image data identification informationstored in association with corresponding color image data in the harddisk 21 in step S608 of FIG. 10, and the color image data associatedwith the relevant color image data identification information areidentified and read from the hard disk 21. Then, in step 704, the readcolor image data are output in visible format.

By performing the above-described processes according to the presentembodiment, color image data that are printed as a monochrome image maybe output as a color image as is necessary or desired based on theprinted monochrome image. More specifically, in the present embodiment,instead of having to go through the trouble of memorizing acorresponding registration number for desired color image data andrequesting for the output of the color image data by designating theregistration number, the user may simply set the printed monochromeimage that he/she desires to view in color image format to the scanner18 in a manner similar to the procedure for operating the scanner 18 toscan a document to be copied or transmitted, for example. In this way, acolor image processing apparatus with good economical efficiency andgood operability may be realized. Also, the processes of adding colorimage data identification information to the monochrome image data to beprinted and extracting the color image data identification informationmay be omitted so that additional information may not have to be addedto the monochrome image data to be printed and the generated monochromeimage data may be closer to the original input color image data.

It is noted that the image comparing method used in step S703 of FIG. 11may involve dividing an image into plural regions, extracting one ormore objects included in each region, and comparing their attributes. Inone specific example, a method as is disclosed in Japanese Patent No.3522146 (Publication No. 11-316846), which is incorporated herein byreference in its entirety, may be used.

It is noted that the process step of FIG. 7A or FIG. 7B may be performedas step S704 of FIG. 11.

According to an embodiment, the process steps of the image data inputcorresponding process of FIG. 2 and the color image data output processof FIG. 3 that are performed in the multifunction machine 1 shown inFIG. 1 may be performed in an image processing system 1 a as is shown inFIG. 12.

The image processing system 1 a of FIG. 12 includes the multifunctionmachine 1 of FIG. 1, a document storing server 40, and a PC 41 that areinterconnected via a LAN 300. In this system 1 a, the multifunctionmachine 1, the document storing server 40, and the PC 41 are configuredto exchange data and information with each other via the LAN 300. It isnoted that the PC 41 may include peripheral devices such as a keyboard,a mouse, an a display (not shown), for example.

In the image processing system 1 a of FIG. 12, the multifunction machine1 uses the document storing server 40 having large capacity data storagefunctions instead of the hard disk 21 corresponding to an internalstorage device of the multifunction machine 1 for storing color imagedata, and the multifunction machine 1 uses the display of the PC 41instead of the LCD 24 corresponding to a display device of themultifunction machine 1 for displaying color image data to performprocess steps illustrated in FIGS. 13 and 14 corresponding to theprocess steps of the image data input corresponding process of FIG. 2and the color image data output process of FIG. 3.

In the image data input corresponding process of FIG. 13, themultifunction machine 1 monitors input of monochrome or color imagedata. Specifically, multifunction machine 1 monitors whether image dataare received or a document is set to the scanner 18 (i.e., loop realizedby determination step S801, a negative determination ‘NO’ in step S801,determination step S802, and the negative determination ‘NO’ in stepS802).

In the determination step S801, reception of image data is monitored. Inthis example, image data reception may be any type of receptionincluding reception realized by the G3 Fax controller 27 through G3facsimile communication via a PSTN (Public Switched Telephone Network)200 (see FIG. 1), reception through real time network facsimilecommunication based on the ITU-T Recommendation T.38 via a LAN 300 (seeFIG. 1), reception through email network facsimile transmission based onthe ITU-T Recommendation T.37, and image data reception in response to aprint request from another PC (personal computer) connected via the LAN300 according to the SOAP protocol, for example. In other words, thereception being monitored in the determination step S801 may generallyinclude any form of image data input from an apparatus or system otherthan the present multifunction machine 1. It is noted that color imagedata transmission/reception through G3 facsimile communication isdefined in the ITU-T Recommendation T.30 Annex E.

When the G3 Fax controller 27 of the multifunction machine 1 receivescolor image data through G3 facsimile communication according to theITU-T Recommendation T.30 Annex E, the CPU 10 issues a document numberfor unambiguously identifying the received color image data, and storesthe document number in association with the corresponding received colorimage data in the hard disk 21.

In the present example, image data may be input in another manner;namely, a document may be scanned by the scanner 18 and the scannedimage data may be input to the multifunction machine 1. Such input ofimage data through scanning by the scanner 18 is monitored in thedetermination step S802.

When it is determined in step S801 that image data are received (‘Yes’in step S801), the image data are received and stored in the hard disk21 (step S803), and the process moves on to determination step S805.

When it is determined in step S802 that a document has been set (‘Yes’in step S802), the image of the document is scanned and the scannedimage data are stored in the hard disk 21 (step S804) after which theprocess moves on to the determination step S805.

In the determination step S805, a determination is made as to whetherthe input image data correspond to color image data or monochrome imagedata. If it is determined that the input image data correspond tomonochrome image data (‘No’ in step S805), a normal monochrome imagedata corresponding process is performed (step S806).

If it is determined in step S805 that the input image data correspond tocolor image data (‘Yes’ in step S805), color image data correspondingprocesses are performed as is described below.

Specifically, the process moves on to step S207 in which a color imagedata identification information generating process is performed. It isnoted that the document number assigned to the input color image data isincluded in the color image data identification information. Then, instep S808, the document number assigned to the input color image data isassociated with the input color image data stored in the hard disk 21beforehand, and the associated data are transmitted to the documentstoring server 40. It is noted that the color image data that have beentransmitted to the document storing server 40 may be deleted from thehard disk 21 once the currently performed operations process is ended.In this way, color image data may be prevented from taking up thestorage capacity of the hard disk 21. It is noted that SOAP (SimpleObject Access Protocol) may be used as the protocol for transmitting thedocument number associated with the corresponding color image data tothe document storing server 40.

Then, in step S809, processing monochrome image data are generated fromthe input color image data. In one example, color image data receivedthrough G3 facsimile communication are encoded according to the JPEGstandard (ITU-T Recommendation T.81, ISO/IEC 10918-1), and the receivedcolor image data are decoded according to the JPEG standard after whichbrightness component data of the respective pixels of the decoded imagedata are extracted to generate the monochrome image data.

Then, the color image data identification information generated in stepS807 is added to (combined with) the generated monochrome image dataaccording to a predetermined format (details of which are describedbelow), and the monochrome image data with the color image dataidentification information are printed on a recording medium such asrecording paper (step S810) after which the process is ended.

The document storing server 40 monitors reception of data transmittedfrom the multifunction machine 1 in step S808 (i.e., loop realized bydetermination step S1001 and a negative determination ‘NO’ in stepS1001). When data transmitted in step S808 are received (‘YES’ in stepS1001), the received document number and the corresponding color imagedata are associated with each other and stored in a large capacitystorage device of the document storing server 40 (step S1002), and theprocess goes back to determination step S1001.

According to the present embodiment, input color image data are printedas a monochrome image so that color toner, color ink, or a color inkribbon (according to the print method implemented by the print engine20) may be saved, and operations cost may be reduced.

More specifically, in the present embodiment, input color image data isautomatically printed as a monochrome image without any commandoperation input from the user. It is noted that in most cases, contentsor features of the input color image data may be adequately grasped fromits corresponding printed monochrome image. Thus, the present embodimentmay be preferred taking into consideration the merits of printing inputimage data as a monochrome image as opposed to a color image.Specifically, cost increase due to color printing undesired images suchas color advertisement and spam images may be avoided. Also, in thepresent embodiment, a color image is not output (printed) fromreproducing (copying) a color document; that is, a monochrome image isoutput upon reproducing the color document while the color image dataobtained in the copying operation are stored to be used in a subsequentreproducing operation. In this way, a document may normally bereproduced as a monochrome image so that cost increase may be avoided.

It is noted that in some cases, a user may desire to view a printedimage of input color image data in its original color image format. Theimage processing system according to an embodiment of the presentinvention is configured to adequately correspond to such desires of theuser.

Accordingly, the image processing system 1 a of the present embodimentis configured to perform the image data input corresponding process asis illustrated in FIG. 13, and the color image data output process as isillustrated in FIG. 14.

In the color image data output process of FIG. 14, the multifunctionmachine 1 monitors the scanner 18 to check if a document is set thereto(loop realized by determination step S901 and the negative determinationstep ‘NO’ in step S901). When a document is set to the scanner 18 (‘Yes’in step S901), the document is scanned and monochrome image data of thedocument are obtained (step S902). It is noted that in step S902, colorscanning of the document may be performed to obtain color image data ofthe document and post processing may be performed on the color imagedata to obtain monochrome image data corresponding to the obtained colorimage data, or alternatively, monochrome image data may be directlyobtained from the document through monochrome scanning, for example.

Then, a color image data identification information extracting processis performed on the obtained monochrome image data (step S903), and theoperations input designating an output destination is determined (stepS904).

In one example, if it is determined in step S904 that ‘PRINT’ isdesignated as the output destination; that is, if the operations inputdesignates printing of the processing color image data on recordingpaper using the print engine 20, which is arranged at the multifunctionmachine 1, the multifunction machine 1 sends a transmission request tothe document storing server 40 requesting for the transmission of thecolor image data corresponding to the color image data identificationinformation extracted in step S903, the transmission request includingthe document number and the transmission destination of the requestedcolor image data (step S905). In the present case, the multifunctionmachine 1 is designated as the transmission destination. It is notedthat the transmission destination information may be any form ofinformation that may enable the document storing server 40 to identifythe multifunction machine 1 over the LAN 300. For example, the IPaddress of the multifunction machine 1 may be used. Also, a host namemay be used, and in such a case, the document storing server 40 isconfigured to access a predetermined DNS (Domain Name System) server(not shown) to perform address resolution and thereby obtain the IPaddress of the corresponding transmission destination.

In the present example, the document storing server 40 monitorsreception of a transmission request that is sent thereto from themultifunction machine 1 in step S905 (i.e., loop realized bydetermination step S1101 and a negative determination ‘NO’ in stepS1101). If a transmission request is received (‘YES’ in step S1101), thecolor image data stored in association with the document number that istransmitted with the transmission request are read out and transmittedto the designated destination; namely, the multifunction machine 1 inthe present case (step S1102), and the process goes back to step S1101.

In response to receiving the requested color image data that aretransmitted from the document storing server 40 in step S1102, themultifunction machine 1 prints the received color image data using theprint engine 20 to output the color image data in visible format (stepS906).

In another example, if it is determined in step S904 that ‘PC’ isdesignated as the output destination at the multifunction machine 1, atransmission request is sent to the document storing server 40requesting for color image data corresponding to the color image dataidentification information extracted in step S903 (step S907). In thiscase, ‘PC’ is designated as the transmission destination in thetransmission request. It is noted that the transmission destination maybe designated by registering the IP address of the PC 41 beforehand asthe destination IP address for ‘PC’, and the transmission request maydesignate the pre-registered destination IP address for ‘PC’ as thetransmission destination, or an IP address may be input each time anoutput destination is designated, for example. Also, it is noted thatthe designation of the transmission destination for ‘PC’ is not limitedto use of an IP address, and a host name may alternatively be used, forexample. In such a case, the document storing server 40 is configured toaccess a predetermined DNS (Domain Name System) server (not shown) toperform address resolution and thereby obtain the IP address of thecorresponding transmission destination.

In the present example, the document storing server 40 monitorsreception of a transmission request that is sent thereto from themultifunction machine 1 in step S907 or step S905 (i.e., loop realizedby determination step S1101 and a negative determination ‘NO’ in stepS1101). If a transmission request is received (‘YES’ in step S1101), thecolor image data stored in association with the document number that istransmitted with the transmission request are read out and transmittedto the designated destination; namely, the PC 41 in the present case(step S1102), and the process goes back to step S1101.

The PC 41 monitors reception of color image data transmitted from thedocument storing server 40 in step S1102 (i.e., loop realized bydetermination step S1201 and the negative determination ‘NO’ in stepS1201), and upon receiving color image data (‘YES’ in step S1201), thePC 41 displays the received color image data on its display monitor(step S1202).

According to the present embodiment, the multifunction machine 1 maymake effective use of the resources of the document storing server 40and the PC 41 that are connected to the multifunction machine 1 via theLAN 300. In this way, a convenient image processing system may berealized that is not constrained by the limitations in the storagecapacity and the display capabilities of the multifunction machine 1.

As can be appreciated from the above descriptions, in the presentembodiment, the image processing system 1 a of FIG. 12 is arranged toperform the process steps of FIGS. 13 and 14 that correspond to theprocess steps of FIGS. 2 and 3 performed by the multifunction machine 1of FIG. 1. It is noted that a similar arrangement is possible withregard to the process steps of FIGS. 10 and 11 performed by themultifunction machine 1 of FIG. 1 according to another embodiment.

Specifically, the image processing system 1 a of FIG. 12, configured todistribute the color image data storing function of the multifunctionmachine 1 to the document storing server 40 and the color image datadisplaying function of the multifunction machine to the PC 41, may bearranged to perform process steps corresponding to the process steps ofFIGS. 10 and 11 performed by the multifunction machine 1 of FIG. 1.

In another embodiment, the process steps of FIGS. 2 and 3 or the processsteps of FIGS. 10 and 11 that are performed by the multifunction machine1 may be adapted for execution by an image processing system 1 b as isshown in FIG. 15.

The image processing system 1 b of FIG. 15 includes a scanner apparatus51, a printer apparatus 52, and a PC 50 that are interconnected via aLAN 300. It is noted that the PC 50 includes peripheral devices such asa keyboard, a mouse, and a display, for example (not shown). The PC 50may be a computer conforming to the PC-AT (Personal Computer forAdvanced Technologies) architecture disclosed by International BusinessMachines Corporation in 1984. In the PC 50, a fax board (not shown) forrealizing G3 Fax communication via a telephone line is arranged to beconnected to a PCI bus, and this fax board is connected to the PSTN 200.

The image processing system 1 b uses the PC 50 to realize functions ofthe multifunction machine 1 such as a color image data receivingfunction (via the PSTN 200), a color/monochrome image data read function(scanner apparatus 51), a color/monochrome image data print function(printer apparatus 52), a color image data display function (displaymonitor of PC 50), and an operations input function. In other words, theinherent functions of a personal computer provided in the PC 50 such asa storage function (e.g., realized by a hard disk) and an informationprocessing function are combined with functions realized by software torealize functions substantially identical to those of the multifunctionmachine 1 in the PC 50. In the present system 1 b, acquisition of imagedata by the PC 50 from the scanner apparatus 51 and transfer of imagedata associated with a print request to the printer apparatus 52 may berealized via the LAN 300 through application control according topredetermined protocols. Accordingly, process steps corresponding tothose of FIGS. 2 and 3 or FIGS. 10 and 11 performed at the multifunctionmachine 1 of FIG. 1 may be realized at the image processing system 1 bof FIG. 15 through application program control of the PC 50.

As can be appreciated from the above descriptions, according topreferred embodiments of the present invention, color image data inputto an image processing apparatus such as the multifunction machine 1 oran image processing system such as the image processing system 1 a or 1b are output (printed) as monochrome image data so that operations costmay be reduced, and at the same time, the original color image data maybe output upon request by a user wishing to view such color image datathrough simple operations. In this way, an economically viable andconvenient image processing apparatus and image processing system may berealized.

Specifically, color image data that are input to an image processingsystem according to an embodiment of the present invention are basicallyprinted as monochrome image data on a recording medium such as recordingpaper rather than printing the input color image data in color format.In this way, consumption of color recording material such as color inkfor inkjet recording, color toner for electrophotographic printing, andcolor ink ribbons for thermal transfer printing may be reduced. It isnoted that in most cases contents of the input color image data may beadequately grasped even when such color image data are printed asmonochrome image data. After the input color image data are printed asmonochrome image data, if a user wishes to view the original input colorimage data, the system of the present embodiment may be arranged to readthe printed monochrome image data as a reference to output the originalcolor image data in visible format. In this way, the original colorimage data may be viewed through simple procedures, and the user may berelieved of the trouble of having to go through complicated proceduresto designate the color image data to be output in color format. Thus,according to an embodiment of the present invention, an economical andconvenient image processing system may be provided that can reduceprinting cost by printing input color image data as monochrome imagedata, and is also suitably adapted for enabling the user to view theoriginal color image data.

According to one embodiment, color image data identification informationis added to the monochrome image data to be printed in order to enableidentification of the corresponding color image data based on theprinted monochrome image data. In another embodiment, color image dataidentification information is not added to the monochrome image data tobe printed so that visual appearance of the printed monochrome image maynot be degraded and inconveniences due to errors in the extraction ofthe added color image data identification information may be avoided,for example.

Although the present invention is shown and described with respect tocertain preferred embodiments, it is obvious that equivalents andmodifications will occur to others skilled in the art upon reading andunderstanding the specification. The present invention includes all suchequivalents and modifications, and is limited only by the scope of theclaims.

The present application is based on and claims the benefit of theearlier filing date of Japanese Patent Application No.2005-031057 filedon Feb. 7, 2005, the entire contents of which are hereby incorporated byreference.

1. An image processing system, comprising: a color image input unitconfigured to input color image data; an identification informationgenerating unit configured to generate color image data identificationinformation identifying the color image data input by the color imageinput unit; an image data storing unit configured to store the colorimage data identification information in association with the processingcolor image data; a monochrome image generating unit configured togenerate monochrome image data based on the color image data; amonochrome image output unit configured to combine the color image dataidentification information with the monochrome image data according to apredetermined format and print the combined monochrome image data on afirst recording medium; an image reading unit configured to read thecombined monochrome image data from the first recording medium and inputthe combined monochrome image data; an identification informationextracting unit configured to extract the color image dataidentification information from the combined monochrome image data; anda color image output unit configured to read from the image data storingunit the color image data associated with the color image dataidentification information extracted by the identification informationextracting unit and output the color image data in a predeterminedvisible format.